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Executive Summary 

Resea re h tells us that systematically incorporating news media into school curricula 
imp roves standardized reading and math scores. But there is little research to tell us 
whetherthese effortsare effective in increasing students' media use, political knowledge 
ortheir sense of being able to understand and influence politics (known asintemal 
political efficacy) - all key elements of civic engagement. 

We address thisgap in the literature with an experiment involving 361 students in four 
high schools in New J ersey. After conducting a baseline survey measuring media use, 
political knowledge, and political efficacy among students, we randomly assigned the 
students 1 social studies classes to one of three conditions: a treatment group assigned to 
read and discussarticlesabout politicsin a newsweekly magazine in class foreight 
weeks; a treatment group in which studentswere assigned to read and discuss the same 
articles at home with their pa rents, with the students subsequently also discussing the 
artic les in the classroom; and a control group that did not receive the magazine and did 
notengage in discussion. We followed up with surveysof the students at the end ofthe 
eight-week intervention, and then six weeks la ter to measure for longer-term effectsof 
the experiment. We also conducted telephone surveys with parentsof 152 students 
during the experiment in orderto measure the relationship between parent and student 
levelsof media use, political knowledge and political efficacy. 

We found that: 

• Ihe combination of reading the artic lesand discussing them at home and school 
wasrelated to increased information-seeking and political knowledge among 
students, but only forthose who were not in advanced placement orhonors 
classes. 

• Ihe combination of reading and discussion at home and at school also was 
related to an increase in students’ internal political efficacy, while the same was 
not true for the group that discussed the artic les only in class and the control 
group that received no exposure to the magazines. 

Ihe effects also varied by parent characteristics Drawing from the sub-sample of 152 
pairs of students and parents, we found that: 

• Studentswho were assigned to disc us the artic lesat home with theirparents, 
and who had parentswho scored low on measuresof political knowledge and 
efficacy, were most likely to have increased scoreson both of those dimensions 
atthe end ofthe experiment. Ihiswastrue only forstudents who were not in 
advanced placement or honorsc lasses. 

Taken together, the results indicate that exposing students to newscoverage about 
politics, and having those students disc us what they read with their pa rents as well asin 
clas, may make students more knowledgeable and efficacious. Ihe effects vary, 
however, by whetherstudentsare in advanced placement or honorsc lasses. Ihe effects 
also vary based on parents' levelsof political knowledge and efficacy. We believe that 
ourresultscould provide guidance to practitioners looking forwaysto enlist potentially 
powerful allies- parents- in reinforcing what happens in the clasroom by extending 
political discusionsto the home as well. 
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Introduction 

According to Ihe Civic Mission of Schools (CMS), one of the principal goalsof civic 
education should be to help students develop the ability to "obtain information, think 
c ritic a lly, a nd enterinto dialogue among others with different perspectives" (2003,4). 
Such an education ought to produce studentswho are "confident in their ability to make 
a difference, and ready to contribute personally to civic and political action" (CMS2003, 
10 ). 

For most citizens, consumption of newsmedia is the primary mode through which they 
acquire political information. Newsconsumption isalso a behaviorthat is frequently 
associated with political discussion, even among young people (Eveland, Hayes, Shah & 
Kwak, 2005; Garramone & Atkin, 1986; McDevitt & Chaffee, 1998, 2000; Wyatt, Kim & 

Katz, 2000). 

Recent genera tionsof young people have been reaching adulthood without 
developing newsconsumption habits(Keeter, Zukin, Andolina &J enkins, 2002; Lopezet 
a I., 2006; Marcelo, 2007; Mindich, 2005; Patterson, 2007; Pew Centerforthe People and 
the Press, 2004). Given the demonstrated link between newsconsumption and political 
knowledge and civic engagement (Conway, Wyckoff, Feldbaum, & Ahem, 1981; 
Garramone & Atkin, 1986; Lopezet a I., 2006), this lag in newsconsumption among youths 
is worrisome. 

In an effort to improve the outcome of civic education foryoung people, we conducted 
a quasi-experimental research project that explored whetherexposing students to news 
coverage in high school, and requiring a subset of those students to discuss the news 
coverage at home with theirparents, influenced subsequent newsconsumption, political 
knowledge and students' sense of having the skills necessary to participate in politic s (i.e. 
their sense of internal political efficacy). We also examined the longer-term effectsof 
exposing students to newscoverage in school and at home on students' news 
consumption, knowledge and efficacy. 



Literature Review 

As Putnam (2000) documented, civic participation in America hasdeclined significantly 
in recent years, with the greatest decline occurring among young people compared to 
their counterparts in previousgenerational cohorts. Recent indicators suggest some 
improvement in the civic engagement of young people. 1 At the same time, a large 
numberof young people are minimally to not at all engaged in the civic and political 
process and exhibit low levels of confidence in government and low rates of political 
knowledge (Bennett, 1997; Lopezet. a I., 2006; Tomey-Purta, 2002). Also, despite steady 
rates of volunteerism, uncertainty regarding the nation'seconomic future seems to be 
shaking youth'sconfidence in the government and theirfuture (Institute of Politics, 2010). 

Likewise, the outlook is not promising when it comes to youth newsconsumption. Unlike 
oldergenerations, young people demonstrate inconsistent and intermittent news 
consumption ha bits (Patterson, 2007) with consumption of newsvia television, radio, 



1 These positive indicators include improved rates of youth voter turnout (beginning with the 2004 presidential election 
through to the 2008 presidential contest); survey research indicating that, for some forms of civic participation, young 
people are quite engaged and are following what is going on in government (Lopez et. al. 2006); and continued youth 
volunteering despite the recent economic downturn (National Conference on Citizenship 2009). 
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magazines, and newspapersconsistently trending downward among 8 th , 10 th , and 12 th 
graders(Marcelo, 2007). Given the influence of newsconsumption on the political 
knowledge and engagement of young people, including expectations among young 
people that they will vote in future elections (Amadeo, Tomey-Purta, & Barber, 2004), 
these results spark concern. 

In response to this c risis in civic engagement, a numberof organizations (private and 
nonprofit), schools, and government agencieshave started initiativesto provide and 
promote civic learning among American youth. Forthe most part, these initiatives have 
focused upon the role of the school in fostering civic competence. This is in keeping with 
the Civic Mission of Schools’ conclusion that schools a re an important institution for 
instilling civic knowledge, skills, and attitudes (2003, 12). Given research indicating that 
school-based civic education is an effective method foraddressing youth civic 
engagement (Niemi & J unn, 1998; Verba, Schlozman, & Brady, 1995), this attention 
see ms justified. 

Accordingly, newsorganizationssuch asCNN, Newsweek, Time, and USNewsand World 
Report have gotten into the business of civic education by implementing various 
classroom programs. Newspapers in Education (NIE) isa program that has been used in 
large numbers of schools and appears to make a positive impact. 2 Sullivan (2001b) found 
that, controlling for other factors, NIE programs positively affect students' scoreson 
standardized reading and math tests and that having an NIE program in at least some 
classrooms increasesthe overall performance ofthe school, on average, by about 10 
percent. 3 

Although NIE programs may increase standardized reading and math scores, there is 
little research to tell us whether these efforts succeed in enhancing students' civic skills, 
attitudes, orknowledge. 4 It isthisgap in the literature that ourresearch addresses. 

Like schools, students' home environment playsan important role in theircivic education, 
and numerous studies (including Andolina, J enkins, Zukin, & Keeter, 2003; J ennings& 
Niemi, 1968, 1974;J ennings, Stoker, & Bowers, 2009; Langton, 1969) have explored the 
role parentsplay asagentsof political socialization. As Verba, Schlozman, & Brady 
indicated (1995), there are three youth experiencesthat affect latercivic participation: 
education, "political stimulation in the home," and involvement in high school activities 
(448). Along these same lines, Niemi and J unn (1998) found that the availability of 
reading and reference materials in the home isassociated with higher levels of political 
knowledge. Accordingly, ourresearch focuseson both education in the school and 
political stimulation in the form of disc ussion of politics at home. 5 



2 According to a study conducted by Sullivan for the Newspaper Association of America Foundation (2001a), the 
number of students served by Newspapers in Education programs grew from 10.8 million in 1992 to 14.4 million in 
2000, a 33% increase. 

3 Furthermore, Sullivan found that these effects are greater in large metropolitan areas than in smaller communities; are 
greater at the middle-school level than at other levels; and, other things being equal, that NIE program effects are 
substantially greater for schools in which most of the students are either minorities or qualify for free or reduced-price 
lunches. 

4 Evidence already exists that exposure to news via television, newspapers, and newsmagazines positively influences 
the political knowledge of elementary students, lower elementary students in particular (ages 8-12) (Hofstetter, 2000). 

5 The use of media as a tool to spur discussion is premised on a growing body of literature that demonstrates that 
political discussion, both in the home and the classroom, positively affects the civic maturation of young people. 
Recent work by McIntosh, Hart, & Youniss (2007) advances previous findings that political discussion in the home 
influences future political involvement by concluding that parental qualities shape the contours of family discussion 
and the political knowledge of young people. 
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Researchers have explored the relationship between school-based interventions and 
media consumption and political discussion, both in the classroom and in the home. A 
seriesof studies (Me Devitt & Chaffee, 1998, 2000; McDevitt& Kiousis, 2004; Saphir& 
Chaffee, 2002) evaluating the effective ness of the KidsVoting USA curriculum found that 
the program is an effective method for increasing media use among students and 
discussion about politics between studentsand theirparents. Moreover, the studies 
suggest that the positive effectsofthe program on youth civic engagement are long- 
lasting. 

Similarly, recent research on the effectsofthe school-based Student Vo ices curriculum 
also found that deliberative discussions in the classroom (along with community projects 
and use ofthe Internet for informational purposes) have a positive effecton political 
knowledge and interest (Feldman, Pasek, Romer, and Ha II J amieson, 2007). Ihiswork 
providesfurthersupport forthe idea that interventions that emphasize classroom 
discussion and media use promote the political development of young people. 

Although this work shares common elementswith ourresearch (i.e. the role of discussion 
and use of media through the Internet) its relevance is limited given that the role ofthe 
family is not considered and that Student Voices is aimed primarily at urban high schools. 

What are the effectson civic engagement when an intervention centerson media 
usage? Consistent with Sullivan'sfindingsregarding NIE programs, the Growing Lifelong 
Readers study conducted by the Newspaper Association of America (2004) found that 
18- to 34-year-olds who said they remembered using a newspaper in school were more 
likely than those who did notto report regularnewspaperreading. Those who recalled 
school-based newspaper use also were more likely to say they were interested in politics 
and local government issues. Although the survey measured discussion of news in the 
home, it was used only as a control variable in determining the relationship between 
newspaper use in school and c urrent involvement with newspapers. These findings a re 
interesting, but somewhat imprecise in that they assume that people a sold as 34 can 
accurately recall whateducational experiencesthey had in elementary, middle, and 
high school. 

The classroom-based portion of ourstudy assessesthe value of a civic education 
program that uses news media asa focal point. By also testing the relative effectiveness 
of a similar intervention aimed atthe family, we sought to determine whetherfactorsthat 
are associated with higher levels of youth engagement when theyemerge 
independently show similar effects when imposed from outside the home. To that end, 
we encouraged familiesto talk about politiesand provided students with reading 
materia Is upon which to base their discussions. 

In addition to ourinterest in the connection between media usage and political 
knowledge, we also paid close attention to the effectsofthe intervention on young 



More recent work focusing on lower-income students of color demonstrates that classroom activities, including the in- 
class discussion of current events, make an even greater impact on the civic development of young people than political 
discussion in the home or the civic-mindedness of the students’ neighborhood, both important determinants of youth 
civic engagement (Kahne & Sporte, 2008). Kahne and Sporte’s recent work builds on Campbell’s (2005) earlier 
finding that the “openness of the classroom environment”, the discussion of current social and political issues by 
teachers and students, positively affects students’ political knowledge and political skills even when controlling for the 
frequency of civics instruction. 
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people'sattitudestoward politics, specifically their sense of internal political efficacy. 
Evidence suggests that there is a positive relationship between efficacy (one's 
confidence in being able to make a difference in public life) and civic engagement 
(Almond & Verba, 1963; Rosenstone & Hansen, 1993). Finkel (1985) haseven posited that 
the effects are reciprocal with civic participation enhancing efficacy. Given this link, the 
impactof a school-based intervention on efficacy deserves attention. Atthe core ofthis 
examination, however, is making clearthe distinction between internal and external 
political efficacy (Balch, 1974). As some scholars have warned (J unn, 2004, Kahne & 
Westheimer, 2006), the failure to understand this distinction can compromise the success 
of well-intentioned interventions designed to boost students' confidence in their ability to 
make a positive difference. 

Scholarshave concluded that internal political efficacy consists of two components: an 
individual's sense of being able to understand politics, and the realization that one has 
the competence to influence government and politics(see Balch, 1974; Finkel, 1985; 
Iyengar, 1980; Lambert, Curtis, Brown & Kay, 1986; Niemi, Craig, & Mattei, 1991). In our 
research, we seekto test the premise that reading and discussing newscoverage on a 
regularbasiswill lead students to conclude thatthey have a strong grasp of politicsand 
that this understanding can aid them in developing the skills they need to be effective 
citizens. 

Previous research hasfound a connection between media exposure and external 
political efficacy among adults (Miller, Goldenberg, & Erbring, 1979). External efficacy, as 
defined by Millerand colleaguesand others(see Niemi, Craig, & Mattei, 1991), refers to 
individuals' perceptionsof government responsiveness to their needsand concerns. 
Milleret al. found that asexposure to newscoverage critical of government increased, 
one's sense of external political efficacy declined. 

But the relationship between media exposure and internal political efficacy could be just 
the opposite: as individuals consume newscoverage they could develop a sense of 
confidence in understanding and being able to influence government affairs. Milleret al. 
said they were not able to test for the relationship between internal political efficacy and 
media exposure using theircross-sectional data because of the potentially reciprocal 
nature of the relationship. A greatersense of internal efficacy could prompt one to seek 
out newscoverage of government and politics, aswell asdevelop a strongersense of 
efficacy asa result of media exposure. This research will attemptto disentangle the 
direction of causality. The p re -test-/ post-test features of our experimental research design 
enable us to address causality by measuring students' internal political efficacy both 
before and after they consume and disc uss newscoverage on a regularbasis. Ourdata 
allow us to use pre-existing levels of internal political efficacy as controls in examining 
potential changes in those areasfollowing the intervention. 

Priorresearch also has not explored the relationship between media exposure and 
internal political efficacy among adolescents. Instead, previous scholarship has 
emphasized the significant role that parents play in passing along their sense of internal 
political efficacy to theirchildren (Dolan, 1995; J ennings& Niemi, 1974). We seekto build 
on that research by examining both parental and media influe nceson the development 
of internal political efficacy among high school students by examining the effectsof 
requiring students to discuss politicsat home with at least one parent. 

Ourworkalso shedslighton the best ways to encourage efficacy through school-based 
interventions. This is especially important in light of wamingssounded by such scholars as 
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Kahne & Westheimer (2006), who argue that, by not distinguishing between internal and 
external efficacy, prog rams designed to promote students' sense of confidence may 
result in just the opposite. Specifically, programs that overtly promote external efficacy 
may not effectively address internal efficacy, and prog rams that focus upon promoting 
internal efficacy may fail to educate students a bout the realities of the political world 
and, thereby, overlook externa I efficacy (2006, 293). 

Although recent research on the effectsofthe Student Voices intervention, with its 
emphasison discussion and Internet use, addressesefficacy (finding that students' levels 
of political efficacy were positively affected by the program), the measure of efficacy 
constructed by the resea rchersdoes not distinguish between internal and external 
efficacy. Instead, a three-point scale of political efficacy is utilized that contains 
measuresof both internal and external efficacy (Feldman et. a I., 2007). With our 
research, we've sought to refine understanding of efficacy and the best usesof school- 
based programs, by considering internal efficacy on itsown. 

Finally, this research also attempts to measure whetherthe effectsof a classroom 
intervention involving news media and discussion at home and at school vary by 
circumstances at home. Fora subset of the student sample we also have survey data 
from interviews with parents. Ihe data include measuresof parents' levelsof news 
consumption, political knowledge and internal political efficacy. We use thisdata to test 
whetherthe benefitsof the intervention are greaterforstudents whose parentsare less 
knowledgeable and engaged, orwhetherthe greatest effectsoccurforstudentswhose 
parentsare more knowledgeable, follow the news regularly, and feel efficacious. 
Variation in these effectsbased on parental characteristicscould eitherprovide 
encouragement that educatorscan reach studentswho might otherwise remain 
disengaged, orindicate thatthistype of classroom intervention is most likely to enrich 
studentswho are already likely to get involved in civic life due to the example set by their 
parents. 

Hypotheses 

Ihe goal of this project then wasto explore whetherexposing students to news coverage 
in school, and requiring a subset of those students to discuss the newscoverage at home 
with theirparents, influencesconsumption of information about politics as well as 
knowledge about, and attitudes toward, politics. We theorize thatwhile classroom 
exposure to media will help to increase civic awarenessand internal political efficacy, 
reinforcing what is learned at school through discussion at home will amplify the effects 
of the classroom intervention. We seekto test the following hypotheses: 

HI: Studentswho read newscoverage of politicsand policy on a regularbasisas 

part of a classroom assignment will seek out information via other news sources and 
family to a greater extent than students in the control group who do not receive the 
classroom intervention. 

H2: Studentswho read newscoverage of politicson a regular basis as part of a 

classroom assignment will become more knowledgeable about politicsthan students in 
the control group who do not receive the classroom intervention. 

H3: Studentswho read the newscoverage with the understanding that they are to 

disc uss it with their pa rents at home will emerge with greater knowledge than students 
who are not instructed to disc uss the newscoverage at home. 
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H4: Studentswho read newscoverage on a regularbasiswill develop a greater 

sense of internal political efficacy than students in the control group who do not receive 
the intervention. 

H5: Studentswho read the newscoverage with the understanding that they are to 

discuss it with their pa rents at home will develop a greatersense of internal political 
efficacy than studentswho are not instructed to discuss the newscoverage at home. 

H6: The beneficial effectsof reading and discussing newscoverage on a regular 

basis will persist even after the intervention ends, as individuals get in the habit of paying 
attention to government and politics. 

H7: The beneficial effectsof reading and discussing newscoverage in a regularbasis 

will be greatest forstudents whose parents scored loweron sc ales of news media 
consumption, political knowledge and political efficacy. 

Research Design 

Thirty-four sub urban public high schools in central New J ersey with similar size and 
socioeconomic profileswere invited to participate in the research project. The research 
team selected fourhigh schools, and a total of 27 social studies classes from the high 
schools participated in the project. Participants from the fourschoolsconsisted of 361 
studentswho completed three surveys in the classroom. 6 

The three surveys measured news consumption, political knowledge, and levelsof 
internal political efficacy as well as a set of demographic questions. Surveys two and 
three were identicalto survey one except they omitted the demographic measures. On 
each survey, a tracking identification numberwasprinted to ensure thatthe completed 
survey was linked to the othersurveysthat each student completed. 

The participating classesfrom the fourhigh schools were randomly assigned to one of 
three groups: 

• Control Group - students assigned to thisgroup completed three surveys over the 
course of the study (134 students total). 

• Treatment Group #1 - students assigned to thisgroup completed three surveys 
and read artic les selected by the research team from Time magazine weekly for 
eight weeks and discussed the artic les in class (106 students total). 

• Treatment Group #2 - students assigned to thisgroup completed the three 
surveys, read Time articles weekly for eight weeks, discussed the articles at home 
with their pa rents and discussed the articles in class (121 students total). 



6 The participating schools required that parents sign consent forms allowing their children to complete the surveys. 
Not all parents gave their consent. If non-participating students were in a treatment classroom, they still received Time 
magazine and were encouraged to participate in class discussions. Students who returned completed consent forms 
received a five-dollar Amazon.com gift card, regardless of whether they received permission to participate. Students 
who participated in the project received a second five-dollar Amazon.com gift card. Parents who completed consent 
forms received a five-dollar, pre-paid phone card. Parents who participated in a telephone survey related to the project 
received a second five-dollar phone card. The research design of the project, including the use of incentives, was 
approved by the Rutgers University Institutional Review Board. 
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The study was conducted from J anuary to May 2008. The research team administered 
the first survey to all of the students in the treatment and control groupsj anuary 14 - 18, 
2008. Students in the two treatment groupsthen received copiesof lime magazine each 
weekforeight weeks. Students were assigned to read two to three articlesabout 
American politics in each issue. Ihe research team selected the articlesand provided 
discussion guideswith suggested questions a bout the articleseach week. Ihe discussion 
guidesfortreatment group 1 are reproduced in Appendix A. Ihe guidesfortreatment 
group 2 were almost identical to those fortreatment group 1. Ihe only difference was 
thatthe students in treatment group 2 were asked to disc us the articlesat home with a 
parentorparentsbefore the classroom discussion. At the completion of the eight-week 
intervention, the research team administered the second survey to all of the students 
March 17 - 24, 2008. Students completed a third survey six weeks later, April 29 - May 2, 
2008, to test whether any effects of reading and disc using the articles were still present. 
Students in the control group completed all three surveys during the same time period 
but did not receive Time magazine. The research team returned to the schools in late 
May- earlyj une 2008 to debrief all of the studentsand present preliminary resultsof the 
study. 

Parentsalso completed a telephone survey overthe course of the experiment. The 
survey contained measuresof media consumption, political knowledge and internal 
political efficacy that were identical to those found in the student surveys. Not all parents 
consented to participate in the survey. 7 Although 361 students participated in the 
experiment and completed questionnaires, the same wastrue foronly 152 parentsof 
students.lhe portion of ourana lysis that addresses parental influence usesthat 
subsample of 152 participating parentsand theirchildren. By sheerhappenstance, the 
distribution of parents and students in the control and treatment groups was 
approximately the same as in the largersample (36% of the participants were in the 
control group in the parent-student subsample, compared to 37% of students in the 
largersample; 28%of the parent-student subsample were in Treatment Group #1, 
compared to 29% in the largersample of students; and 36%ofthe parent-student 
subsample were in Treatment Group #2, compared to 34% in the largersample of 
students). 



7 Luce Research of Colorado Springs, CO conducted the telephone interviews. Parents of 275 students who participated 
in the project signed consent forms in which they agreed to participate in telephone interviews. Using contact 
information provided by the parents Luce Research completed interviews with parents of 152 students. In instances 
where both parents signed consent forms, Luce Research selected one parent at random to do the interview. The 
complete call disposition for the parents is available from the authors upon request. 
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lable 1- Characteristics of Study Participants 







subject 

pool 


LUIILIUI 

group 


Treatment 1 


Treatment 2 




Freshman 


26% 


46% 


30% 


0% 


Year 


Sophomore 


40% 


11% 


68% 


47% 




J unior 


2% 


0% 


2% 


3% 




Senior 


33% 


43% 


0% 


50% 




Female 


47% 


52% 


42% 


46% 


Gender 




Ma le 


53% 


48% 


58% 


54% 




White 


87% 


84% 


91% 


88% 


Race 




Nonwhite 


13% 


16% 


9% 


12% 


In an AP or 


Yes 


19% 


30% 


0% 


24% 


honorsclass 


No 


81% 


70% 


100% 


76% 


Total participants 




361 


134 


106 


121 



Notes: Percentages are column percentages foreach demographic category, and they may not sum to 100 
percent due to rounding. The control group simply completed three surveys. Treatment group 1 completed the 
surveys, read articles about politics from Time magazine and discussed the articles in class. Treatment group 2 
completed the surveys, read the same articles, and were instructed to discuss the articles at home before 
discussing them in class. 



The subject pool was distributed across freshmen, sophomores and seniors, but there 
were fewerjuniors in the pool. Large portionsof the control and treatment 1 groupswere 
freshmen, while the treatment 2 group consisted of mostly sophomores and seniors. 
About one-fifth of students in the control group and one-fourth of students in the 
treatment 2 group were in advanced placement or honors history classes, although 
none of the treatment 1 subjectswere in AP or honorsc lasses. To account forva nation 
acrossall of these dimnesions, we include year, gender, race, and type of course in 
multivariate ana lyses of the questionnaire responses. 

Ihe sample of parentswho completed the survey also varied along demographic lines. 
Ihe parent sample was: 75 percent female, 91 percent white, 65 percent had at leasta 
college degree, 55 percent had annual incomesof $100,000 ormore, and the average 
age was47.9 yearsold. 



Methods of Ana lysis 

We analyzed the data several ways. We began by first comparing baseline levels of 
information-seeking, political knowledge and political efficacy (survey 1) to levelsof 
those constructs immediately after the intervention (survey 2) and six weeks afterthe 
intervention ended (survey 3). We looked forchangesovertime, and forlargerchanges 
in the treatment groupsthan in the control group. We tested forthese changesby 
conducting difference of means tests that compared mean levelsof each construct for 
each group from survey 1 to survey 2, and from survey 1 to survey 3. 
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Although we randomly assigned classesto treatment and control groups, baseline levels 
of information-seeking, knowledge and efficacy still varied somewhat between the 
groups. Asa result, isolating the effectsofthe experiment required that we take into 
account other potential predictorsof information-seeking, knowledge and efficacy. We 
ran multivariate models that controlled forstudents' gender, race, yearin school, and 
whether the student was in an advanced placement or honors class to filter out those 
influences. 

Given that ourdependent variableswere scalesthat were continuous in nature, 

Ordinary Least Squares (OLS) regression would have been the logical approach for 
multivariate analysis. Butwe also needed to take into account the possibility of school- 
level effects. One of the key assumptions of OLS regression is independence of the 
observations. That students in the subject pool attended the same school may have 
violated that assumption, resulting in correlated errortermsfordata from students within 
each school. Violating that assumption could lead to standard errors that are smaller 
than they should be, resulting in Type I errors in interpreting the results (Luke 2004). 

Foreach set of multivariate models, ourfirststep wasto determine whetherwe needed 
to run multi-level models that controlled foreffectsatthe school level. We ran a seriesof 
random intercept models that examined both the between-school and within-school 
variation for the dependent variables using the intercept and no other predictors (see 
Luke 2004, Singer 1998 for further exp la nation of thisapproach). We found no statistically 
significant evidence of between-school variation for information-seeking, so we were 
confident that OLS regression would be an acceptable analytic approach. We did find 
evidence of slight between-school variation forourothertwo dependent variables- 
political knowledge and political efficacy- so we ran multi-level models in which the 
intercepts in the models varied randomly at the school level while the independent 
variables provided the fixed effects forthe models. 

We also examined the possible influencesof parental levelsof information-seeking, 
knowledge and efficacyfora subset of students for whom we had comaprable data 
from their parents (N = 152). We ran a seriesof random intercept models first for these 
analyses, and found no evidence of school-level effects. Thus we used OLS regression for 
the analysesin which we tested forparental influenceson students' levelsof information- 
seeking, knowledge and effiacy. 



Findings 

Sources of Information for Students 

We measured use of sourcesof political information with nine questions that we 
repeated in each of the three surveys: 

"Out of the last seven days, how many days have you for information 

about government orpolitics?" 

1. Read a local newspaper 

2. Read a national newspaper, such as USA Today orthe Wall StreetJ oumal 

3. Listened to a radio newscast 

4. Watched a local television newscast 
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5. Watched a national television newscast 

6. Read a news site on the Internet 

7. Read a blog on the Internet 

8. Listened to a podcast on the Internet 

9. "Out of the last seven days, how many days have you talked about government 
orpoliticswith someone in yourfamily?" 

In the coding forall nine questions, responses ranged from zero to seven. Studentswho 
said they did not know or who did not answer the questions were coded at the mean of 
the response to each question foreach wave to reduce the incidence of missing data. 

Ourfirst hypothesis is that use of newssourcesto get more information about government 
and politics would increase from survey 1 to survey 2 for the treatment groups but would 
not change forthe control group. We found this to be the case forsome newssources, 
but not others. 



Table 2- Difference of Means for Use of Information Sources 






Survey 1 (Pre-test) 


Survey 2 (Post-test) Survey 3 (Post-test) 


N 


Local newspaper 


Control 


1.01 


1 32** 


1.08 


134 




Treatment 1 


1.08 


1.49** 


1.24 


106 




Treatment 2 


1.64 


2.05** 


1.51 


121 


National 

newspaper 


Control 


0.4 


0.68* 


0.50 


134 




Treatment 1 


0.56 


0.96** 


0.88+ 


106 




Treatment 2 


0.88 


1.14* 


0.96 


121 


Radio newscast 


Control 


1.53 


1.75 


1.30 


134 




Treatment 1 


1.26 


1.70* 


1.36 


106 




Treatment 2 


1.49 


1.48 


1.4 


121 


Local TV news 


Control 


2.21 


2.41 


2.00 


134 




Treatment 1 


2.44 


2.27 


1.83** 


106 




Treatment 2 


2.6 


2.97+ 


2.31 


121 


Nationally news 


Control 


2.35 


2.22 


1.99+ 


134 




Treatment 1 


1.96 


2.08 


1.67 


106 




Treatment 2 


2.67 


2.89 


2.47 


121 


Internet news site 


Control 


1.73 


1.88 


1.61 


134 




Treatment 1 


0.73 


1.08* 


1 21** 


106 




Treatment 2 


1.97 


2.37* 


1.93 


121 


Blog 


Control 


0.61 


0.5 


0.38* 


134 




Treatment 1 


0.33 


0.39 


0.55+ 


106 




Treatment 2 


0.68 


0.54 


0.62 


121 


Podcast 


Control 


0.04 


0.12+ 


0.26** 


134 




Treatment 1 


0.14 


0.18 


0.32 


106 




Treatment 2 


0.15 


0.18 


0.17 


121 
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Talk with family 


Control 


2.65 


2.72 


2.43 


134 




Treatment 1 


2.03 


2.43* 


2.22 


106 




Treatment 2 


2.76 


3.05+ 


2.46+ 


121 



Notes: Entries are the mean number of days out of the previous seven that students used each source for 
information about politics. Difference of meansbetween survey 2 or3 and survey 1 is significant at +p <0.10, * 
p <0.05, ** p <0.01. (Two-tailed tests.) 

To test the hypothesis, we calculated the mean usage of each newssource forthe 
treatment and control groups priorto the experiment (survey 1), just afterthe experiment 
(survey 2) and six weeks afterthe experiment (survey 3). Difference of means tests 
revealed statistically significant increases in use of radio for treatment group 1 from 
survey 1 to survey 2; viewing of local television news for treatment group 2; and increases 
in reading of newson the Internet and family conversations to get newsabout politicsfor 
both treatment groups. But both the treatment and control groupsshowed significant 
increases in mean usage of local and national newspapers, and the control group 
showed a slight increase in use of Internet podcasts for information about politics 
(although the actual incidence of listening to pdocasts, as well asreading blogs, was 
quite low across a II groups). 

Ihe overall finding indicates that students reported using multiple newssources more 
frequently in survey 2 compared to survey 1. But did this increase hold up overtime? Ihe 
answer is no. Across a II of the groupsand allofthe categories, the frequency of use of 
the various sourcesdropped in survey 3, six weeks afterthe experiment ended. Although 
there were net increases from survey 1 to survey 3 in a few categories, most of the mean 
levelsof usage in survey 3 were at orbelow the levels found in survey 1. 

Looking at the patterns of news consumption across individual sources might obscure 
largerchangesin behavior. It is unlikely that students (or anyone forthat matter), would 
rely exclusively on one source for information about politics. Instead, a largerpattem of 
info rmation-see king might be a more accurate depiction of behavior. We combined the 
nine measures of usage of information sourcesinto scales, and measured changes in the 
sc ales over time. 8 



Table 3 - Changes in Information- Seeking Overthe Three Surveys 





Survey 1 (Pre-test) 


Survey 2 (Post-test) 


Survey 3 (Post-test) 


N 


Control 


12.54 


13.6+ 


11.56+ 


134 


Treatment 1 


10.52 


12.59* 


11.29* 


106 


Treatment 2 


14.83 


16.67* 


13.83 


121 



Notes: Entriesare means of sc ales of information-seeking. 

The coefficient alpha forthe scale was 0.81 for survey 1, 0.80 for survey 2, and 0.83 for survey 3. 



s The scales were highly reliable. The coefficient alpha for the scale for survey 1 was 0.81, 0.80 for survey 2 and 0.83 
for survey 3. 
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The difference of means between survey 2 and 3 and survey 1 is significant at +p <0.10, * p <0.05, ** p <0.01. 
(Two-tailed tests.) 



Breaking down the difference in means forthe scale from survey 1 to survey 2 showed 
that, although the mean of the scale increased from survey 1 to survey 2 forboth the 
treatment and control groups, the difference was significant only at the level of p <0.10 
forthe control group, while the difference wassignificant at p <0.05 forthe two 
treatment groups. The difference in meansfrom survey 1 to survey 2 was also slightly 
largerforthe treatment groupsthan forthe control group. The means forall three groups 
declined from survey 2 to survey 3, and dropped below the levels found in survey 1 for 
the control group and treatment group 2. Thus whatever benefit that the experiment 
may have brought about diminished afterthe experiment ended. 

Comparing meansfrom one survey to another, and across the different groups, may not 
provide a complete picture. In examining changesovertime, it is important to consider 
other factors that might be at work beyond the treatment conditions. We put ourfirst 
hypothesis to an additional test by examining the possible effects of other variables on 
the level of information-seeking before and afterthe survey. Our multivariate model 
needsto take into account the potential confounding effectsof the demographic 
characteristics of the students (year in school, race and gender), and student aptitude 
asreflected bythe type of class the student is in (whetherthe class isan advanced 
placement or honors class or not). 

The models for information-seeking afterthe magazine intervention (as measured in 
survey 2) showed some evidence that the intervention prompted students to lookto 
other sources more frequently for info rmation about politics, but only after taking into 
account both the type of treatment and student aptitude. 
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Table 4- Predictors of Information- Seeking 
Post-Treatment (Survey 2) 


Model 1 


Model 2 




Coeffic ient 


S.E. 




Coeffic ient 


S.E. 


Intercept 


5.59** 


1.64 


Intercept 


4.96** 


1.69 


Information- 

seeking 

pre-test 


0.69** 


0.04 


Information- 

seeking 

pre-test 


0.69** 


0.04 


White 


-0.75 


1.11 


White 


-0.56 


1.12 


Female 


-0.75 


0.75 


Female 


-0.76 


0.75 


Yearin 

school 


0.17 


0.35 


Yearin 

school 


0.33 


0.37 


Treatment 
group 1 


0.47 


0.95 


Treatment 
group 1 


0.58 


0.96 


Treatment 
group 2 


1.36 


0.91 


Treatment 
group 2 
in an AP or 
honors 
course 


-0.49 


1.57 








Treatment 
group 2 not 
in an AP or 
honors 
course 


1.78+ 


0.96 


Adjusted R- 
squared 


0.49 


Adjusted R- 
squared 


0.49 



Notes: The dependent variable is the scale of information seeking behaviors measured in survey 2 afterthe 
magazine intervention. Coefficientsare unstandardized Ordinary Least Squares regression estimates. 



N =361 

+ p <0.10, *p <0.05, **p <0.01 (Two-tailed tests) 



The model controlled forprevious levelsof information-seeking by using the data 
gathered in the first survey. We also controlled forrace, gender, and yearin school. We 
used dummy variables to distinguish between studentswho were in the treatment 1 
group, which only discussed the magazine articlesin class, and the treatment 2 group, 
which discussed the articlesat home with at leastone parent and in class. Ihe control 
group served asthe omitted reference category forthe dummy variables. We also ran a 
second model in which we accounted forwhetherthe student wasin an AP orhonors 
class No students in treatment group 1 fell into this category, but 24 percent of students 
in treatment group 2 were in an AP orhonorsclass. So we separated students in 
treatment group 2 into one of two categoriesbased on whetherthe students were in an 
AP or honors class. 

It was not surprising that information-seeking habits from before the treatment were the 
strongest predictorof information-seeking afterthe treatment in both models. No other 
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variable in Model lexerted a statistically significant effect. Further ana lysis, however, 
revealed an interesting finding forthe combination of treatment and aptitude. In Model 
2, when we broke down the membersof treatment group 2 by whetheror not they were 
in an AP or honors course, we found that students who were not in an AP orhonors 
course reported an increased level of information-seeking afterthe treatment relative to 
students in the control group (p <0.10). There was no significant change associated with 
treatment 2 studentswho were in an AP orhonorsclass. This suggests that the 
combination of reading the magazine articlesand discussing them at home and at 
school had a beneficial effectforstudentsoutside of the AP/ honors track. 



Student Political Knowledge 

We also hypothesized that the magazine intervention would affect political knowledge in 
two ways. We expected that studentswho read newscoverage of politicson a regular 
basisaspartof a classroom assignment would become more knowledgeable in those 
areasthan students in the control group who did not receive the classroom intervention 
(hypothesis #2). We also expected thatthese gains in knowledge would be greater 
among studentswho were assigned to discuss the articlesat home with theirparentsas 
well as in the classroom, with the two sets of discussions reinforcing the effects of each 
other (hypothesis #3). 

We measured political knowledge by repeating seven questions in each of the three 
surveys: 

"Next we have a set of questions concerning various public figures. We want to see how 
much information a bout them gets out to the public from television, newspapers and the 
like. 

1. Nancy Pelosi. What job orpolitical office doesshe now hold? (Open-ended 
responses were coded 2 if students identified Pelosi asspeakerof the House, 1 if they 
identified herasa memberof Congress, and 0 for a II other responses.) 

2. DickCheney. What job orpolitical office doeshe now hold? (Open-ended 
responses were coded 1 if students identified Cheney asvice president, and Oforall 
other responses.) 

3. Vladimir Putin. What job orpolitical office doeshe now hold? (Open-ended 
responses were coded 1 if students identified Putin as president or leaderof Russia, and 0 
for a II other responses.) 

4. J ohn Roberts. What job orpolitical office doeshe now hold? (Open-ended 
responses were coded 2 if students identified Roberts as chief justice ofthe U.S. Supreme 
Court, 1 if they identified Robertsasa Supreme Court justice, and Oforall other 
responses.) 

5. Which political party hasthe most members in the U.S. House of Representatives? 
(1 ^correct response, 0 = incorrect response) 

6. Which political party hasthe most membersin the U.S. Senate? (1 =correct 
response, 0 = incorrect response) 
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7. Of the two political parties, which one is more conservative than the other?" (1 = 
correct response, 0 = incorrect response) 

Ihe scale ranged from Oto 9 points.lhe coefficient alpha forthe scale was0.60for 
survey 1, 0.65 forsurvey 2, and 0.68 forsurvey 3. 

We found that knowledge did, indeed, increase from survey 1, before the intervention, to 
survey 2, afterthe intervention. 



lable 5 - Changes in Political Knowledge Overthe Ihiee Surveys 





Survey 1 (Pre-test) 


Survey 2 (Post-test) 


Survey 3 (Post-test) 


N 


Control 


2.46 


3.04** 


3.08** 


134 


Treatment 1 


1.97 


2.4** 


2.52** 


106 


Treatment 2 


2.93 


3.87** 


3.97** 


121 



Notes: Entriesare means of sc ales of political knowledge. 

The coefficient alpha forthe scale was 0.60 forsurvey 1, 0.65 forsurvey 2, and 0.68 forsurvey 3. 

The difference of means between survey 2 and 3 and survey 1 is significant at + p <0.10, * p <0.05, ** p <0.01. 
(Two-tailed tests.) 



Knowledge increased forthe entire sample with statistically significant gainsoccurring 
not just in the two treatment groups but in the control group as well. The initial levels of 
knowledge asmeasured in survey 1 were higherin the control group and treatment 
group 2 compared to treatment group 1, possibly due to the AP and honors students in 
those groups. The greatest increase occurred among treatment group 2, with the 
average score going up by almost one point from survey 1 to survey 2. Levels of 
knowledge remained higher a cross all groups afterthe experiment as well, with gains in 
knowledge persisting for a II three groups when comparing results of survey 3 to results of 
survey 1. 

As we did forourmodel of newsconsumption, we tested forbetween-school variation in 
the data before running multivariate models, and we found slight evidence of such 
variation. The intra class correlation between the between-school variance and within- 
school variance of the dependent variable was0.05, suggesting that between-school 
variation accounted for five percent of the variance in the data . While this level of 
between-school variation is low, we tookthe conservative approach of running a 
random-intercept model to examine the effects of existing levels of knowledge, the 
treatment, demographics and student aptitude on the scale of political knowledge in 
the second survey. The model allowed the intercept to vary randomly at the school level 
to accountforthe between-school variation in the data. 
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Table 6- Predictors of Political Knowledge 
Post-Treatment (Survey 2) 


Model 1 


Model 2 




Coeffic ient 


S.E. 




Coeffic ient 


S.E. 


Intercept 


1.63** 


0.43 




1.33* 


0.54 


Po litic a 1 

knowledge 

pre-test 


0.85** 


0.4 


Political 

knowledge 

pre-test 


0.86** 


0.04 


White 


0.07 


0.19 


White 


0.08 


0.19 


Female 


-0.26+ 


0.13 


Female 


-0.26* 


0.13 


Yearin 

school 


-0.29* 


0.12 


Yearin school 


-0.17 


0.19 


Treatment 
group 1 


-0.58* 


0.21 


Treatment 
group 1 


-0.60** 


0.22 


Treatment 
group 2 


0.66** 


0.18 


Treatment 
group 2 
in an AP or 
honorscourse 


0.28 


0.47 








Treatment 
group 2 not in 
an AP or 
honorscourse 


0.68** 


0.19 


Log- 

likelihood 


-586.3205 with 9 df 


Log- 

likelihood 


-585.9629 with 10 df 



Notes: The dependent variable is the scale of political knowledge measured in survey 2 afterthe magazine 
intervention. Coefficients a re fixed effects in a random intercept model using maximum likelihood estimation. 

To test for model fit, we compared the log-likelihood of an unrestricted model, in which we assumed the 
treatment conditions had no effect on political knowledge, to Models 1 and 2, in which we assumed the 
treatments had an effect on political knowledge. A likelihood ratio test showed that including the treatment 
group variables in Model 1 provided a statistically significant improvement in the fit of the model to the data (p 
<0 .01). Including the treatment group variablesin Model 2 also provided a statistically significant improvement 
in the fit of the model to the data (p <0.01). 



N =361 

+ P <0.10, *p <0.05, **p <0.01 (Two-tailed tests) 



As with ouranalysisof information-seeking, we ran two models forpolitical knowledge, 
with Model lexamining the effectsof treatments 1 and 2 compared to the control 
group, and Model 2 isolating the effectsof treatment group 2 forstudents in AP orhonors 
classand studentswho were not in those classes. 

In both models, political knowledge asmeasured in survey 1 wasthe strongest predictor 
of political knowledge in survey 2. Genderand yearin school also were significant. 
Females had lower levels of political knowledge than males in survey 2 (at the level of p < 
0.10) and knowledge increased forstudents who were earlierin theirhigh school studies. 

In Model 1, the dummy variables for treatment 1 and treatment 2 were both statistically 
significant at the level of p <0.01, but the coefficients ran in opposite directions. Students 
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in treatment group 1 had a lowerlevel of political knowledge in survey 2 compared to 
students in the control group. Students in treatment group 2 had a higher level of political 
knowledge than the control group. This suggests that something in addition to the 
treatment wasdriving political knowledge in the groups. It may have been that students 
in the control group also were learning because of the time in which the survey was 
conducted, even controlling for other factors. Disaggregating the honors versus non- 
honors students in Model 2 showed that it was the non-honors students who benefitted 
from treatment 2. Those students had a higher level of political knowledge in survey 2 
than did students in the control group, holding all other factors in the model constant. AP 
and honors students in treatment 2 did not have a statistically significant difference in 
political knowledge compared to the control group. 



Student Political Efficacy 

We also hypothesized that students who received the magazine intervention would 
emerge with an increased level of internal political efficacy compared to the control 
group (hypothesis #4), and thatthe greatest gains would occuramong studentswho 
were instructed to disc ussthe articles at home with a parent or parents as well as in the 
classroom (hypothesis #5). 

We measured internal political efficacy using a scale of three items from the American 
National Election Study: 

1. I consider myself well-qualified to participate in politics. (1 =disagree strongly, 2 = 
disagree somewhat, 3 =neitheragree nordisagree / don't know, 4 =agree somewhat, 5 
= agree strongly) 

2. I feel that I have a pretty good understanding of the important political issues 
facing ourcountry. (1 ^disagree strongly, 2 ^disagree somewhat, 3 =neitheragree nor 
disagree / don't know, 4 =agree somewhat, 5 =agree strongly) 

3. I thinkthat I am as well-informed about politicsand government asmost people. 
(1 ^disagree strongly, 2 ^disagree somewhat, 3 = neitheragree nordisagree / don't 
know, 4 =agree somewhat, 5 =agree strongly) 

The scale ranged from three to 15. The coefficient alpha forthe scale was 0.80 for survey 
1, 0.82 forsurvey 2, and 0.81 forsurvey 3. 

We found that levelsof internal political efficacy increased from survey 1 to survey 2, but 
only forthe treatment 2 group. 



Table 7 - Changes in Internal Political Bficacy Overthe Three Surveys 





Survey 1 (Pre-test) 


Survey 2 (Post-test) 


Survey 3 (Post-test) 


N 


Control 


8.94 


9.1 


9.54** 


134 


Treatment 1 


9.27 


9.33 


9.3 


106 


Treatment 2 


9.33 


10.02** 


10.07** 


121 
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Notes: Entriesare means of sc ales of internal political efficacy. 

The coefficient alpha for the scale was 0.80 for survey 1, 0.82 for survey 2, and 0.81 for survey 3. 

The difference of means between survey 2 and 3 and survey 1 is significant at + p <0.10, * p <0.05, ** p <0.01. 
(Two-tailed tests.) 



Difference of meanstests found that internal political efficacy remained the same for 
treatment group 1 in each of the three surveys. The control group saw a statistically 
significant increase, but only in survey 3 compared to survey 1. Internal political efficacy 
inc reased significantly for treatment group 2 from survey 1 to survey 2, and efficacy 
remained significantly higherin survey 3 compared to survey 1 forthisgroup. Treatment 
group 2 showed the largest overall increase of the three groups across the three surveys. 

We then examined the difference in internal political efficacy from before and after the 
intervention using a multivariate model. Priorto running the model, we checked for 
between-school variation in the data, and found an intra class correction of 0.02. That 
meant thattwo percent of the variance in the data wasdue to the schools that the 
students attended. Although thisisa small amount of variance, once again we tookthe 
conservative approach and ran a random-intercept model, allowing the interceptto 
vary randomly for each school to account for the between-school variation in the data. 
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Table 8- Predictors of Internal Political Efficacy 
Post- Treatment (Survey 2) 


Model 1 


Model 2 




Coeffic ient 


S.E. 




Coeffic ient 


S.E. 


Intercept 


2.61** 


0.55 


Intercept 


2.77** 


0.57 


Political 

efficacy 

pre-test 


0.74** 


0.04 


Political 

efficacy 

pre-test 


0.74** 


0.04 


White 


-0.31 


0.31 


White 


-0.34 


0.31 


Female 


0.01 


0.21 


Female 


0.006 


0.21 


Year in 
school 


0.05 


0.10 


Yearin 

school 


0.01 


0.10 


Treatment 
group 1 


0.01 


0.27 


Treatment 
group 1 


0.01 


0.26 


Treatment 
group 2 


0.59* 


0.25 


Treatment 
group 2 
in an AP or 
honors 
course 


1.03* 


0.44 








Treatment 
group 2 not 
in an AP or 
honors 
course 


0.50+ 


0.26 


Log- 

likelihood 


-751.2996 with 9 df 


Log- 

likelihood 


-750.6255 with 10 df 



Notes: The dependent variable is the scale of internal political efficacy measured in survey 2 after the 
magazine intervention. Coefficients a re fixed effects in a random intercept model using maximum likelihood 
estimation. 

To test for model fit, we compared the log-likelihood of an unrestricted model, in which we assumed the 
treatment conditions had no effect on political efficacy, to Models 1 and 2, in which we assumed the 
treatments had an effect on political efficacy. A likelihood ratio test showed that including the treatment group 
variables in Model 1 provided a statistically significant improvement in the fit of the model to the data (p <0 
.05). Including the treatment group variables in Model 2 also provided a statistically significant improvement in 
the fit of the model to the data (p =0.08). 



N =361 

+ p <0.10,*p <0.05, **p <0.01 (Two-tailed tests) 



Internal political efficacy in the first survey is the strongest predictorof internal political 
efficacy in the second survey in both models 1 and 2. Treatment 2 wasthe only other 
statistically significant predictorin Model 1. Studentswho discussed the magazine articles 
at home with their pa rents as well asin the classroom scored hig heron the internal 
efficacy scale in survey 2 than did the students in the control group, controlling for pre- 
existing levelsof internal efficacy in survey 1. Treatment 1 had no significant effect on 
internal political efficacy in survey 2 when holding all other variables constant. 
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Breaking out the students in treatment group 2 by whetherthey were in an AP or honors 
class showed thatthe effect of the treatment varied by the aptitude of the students. 
Model 2 showed that while both sets of students in treatment group 2 scored higher on 
political efficacy in survey 2 than students in the control group, the AP and honors 
students showed gains that were nearly twice as large as treatment 2 students who were 
not in an AP or honors class. Also, the statistical significance of the effect of treatment 2 
on the AP and honors students was less than 0.05, while the signifiance of the effect for 
the other students in the treatment was less than 0.10. It is possible thatthe rich get richer, 
so to speak, in thatthe AP and honors students may have derived a greater benefit from 
the treatment than their counterparts in otherclasses. It may be thatthe more 
advanced studentswere more receptive to the citizen-building effectsof reading about 
and discussing politics, with the added benefit of reinforcement at home. 

rental Influence 

The concept of the rich getting richerisan important consideration in this research. If the 
greatest benefits a crrue to the most advanced students, then the intervention may be of 
less value than if all students benefit, or if less advanced students profit most from the 
intervention. The data presented here suggest that that the intervention involving parents 
was most helpful to students outside of AP and honors classes when it comesto media 
consumption and political knowledge, and that advanced students derived the greatest 
benefit in terms of internal political efficacy. 

Another way of measuring the impact of the intervention centers on the home 
environment and whetherthe effectsof the intervention vary based on whether 
students' parentsare frequent consumers of media, knowledgeable about politicsand 
highly efficacious when itcomesto politics. If the benefits vary by parental 
characteristics, are the benefitsgreaterforstudents with informed and engaged parents 
orforstudents whose parentsare lessknowledgable and efficacious? If the greater 
benefitsoccurforstudentsin the lattergroup, then the value of the intervention would 
be highergiven the widely accepted educational goal of creating a more informed, 
knowledgeable and engaged citizenry. 

We attempted to measure the effectsof the home enrivonment by surveying parentsof 
students who participated in the experiment. We were able to complete telephone 
interviews with a parent of 152 of the 361 students who participated in the experiment. 
The parent surveys contained identifical measuresof media consumption, political 
knowledge and internal political efficacy. We calculated parent scores on the scalesfor 
media use, knowledge and efficacy, and we used the scoresto categorize studentsas 
having pa rents who scored high or low on the various sc ales comp a red to the overall 
pool of parents. We calculated both meansand media ns forthe parent scores, and 
used the median asthe cut point because the scoreson each scale had distributions 
that were skewed slightly toward the upperendsof the scales. Parents who scored at or 
below the median on each scale were considered to be in the low group forthat scale, 
while parentswho scored above the median were classified asbeing in the high group 
forthat scale. 

We re-ran the models predicting student scores in wave 2 for media consumption, 
political knowledge and internal political efficacy and divided the sub-sample based on 
whether students had parentswho scored high orlow on the relevant dimension in 
question (media use, knowledge orefficacy). Thisexercise allowed us to gauge whether 
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the experiment's benefits varied by whether students had a parent strong orweakon 
these dimensions. Drilling down to this level, however, also resulted in small sub-samples 
(ranging from 66 to 86 students) and largerstandard errors, making it potentially more 
difficult to find significant p red ic tors of student media use, knowledge and internal 
efficacy in wave 2. 

Once again, we tested forschool-level effects in the subsample of students for whom we 
had parent data by running random intercept models with the intercept asthe only 
predictor. Foreach dependent variable - student media use, student knowledge and 
student political efficacy in wave 2 - we could notfind evidence of school-level effects 
that would require the use of multi-level models. Asa result, we used Ordinary Least 
Squares regression foreach ofthe analyses involving parentdata. 



Table 9- Predictors of Student Information- Seeking 
Post-Treatment (Survey 2) - Subsamples with Parent Data 


Model 1 - Students With Parents 
Low in Information-Seeking 


Model 2 - Studentswith Parents 
High in Information-Seeking 




Coeffic ient 


S.E. 




Coeffic ient 


S.E. 


Intercept 


1.53 


3.68 


Intercept 


4.79 


3.30 


Information- 

seeking 

pre-test 


0.68** 


0.07 


Information- 

seeking 

pre-test 


0.61** 


0.09 


White 


-0.90 


2.63 


White 


-0.90 


2.54 


Female 


-0.04 


1.54 


Female 


0.06 


1.51 


Yearin 

school 


1.24 


0.79 


Yearin 

school 


2.05* 


0.82 


Treatment 
group 1 


1.31 


1.86 


Treatment 
group 1 


-1.66 


1.94 


Treatment 
group 2 
in an AP or 
honors 
course 


-0.52 


3.02 


Treatment 
group 2 
in an AP or 
honors 
course 


-6.29* 


2.93 


Treatment 
group 2 not 
in an AP or 
honors 
course 


1.79 


2.14 


Treatment 
group 2 not 
in an AP or 
honors 
course 


0.80 


2.15 


Adjusted R- 
squared 


0.58 


Adjusted R- 
squared 


0.52 


N 


77 


N 


75 



Notes: The dependent variable is the scale of information seeking behaviors measured in survey 2 afterthe 
magazine intervention. Coefficientsare unstandardized Ordinary Least Squares regression estimates. 

-t-p <0.10, *p <0.05, **p <0.01 (Two-tailed tests) 

In termsof media use in wave 2, the experiment had no measurable benefits forstudents 
whose parents scored low on media consumption. The strongest predictorof student 
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information-seeking in wave 2 wasstudent information-seeking in wave 1, and there 
were no significant effects for students in treatment group 1, the AP/ honors students in 
treatment group 2, and the no n-AP/ honors students in treatment group 2. Ihe same was 
true forstudents whose pa rents scored high on information-seeking, but with one 
exception. Advanced placement and honors students in treatment group 2 who had 
parentswho used media frequently had lowerlevelsof media use in wave 2 compared 
to students in the control group whose parents used media frequently. This is a couinter- 
intuitive result suggesting that some other factor beyond the experiment was influencing 
media use for these students. 

Ana lyses of student political knowledge in wave 2, however, revealed some interesting 
results. Ihe effectsof the intervention in thiscase appeared to vary by whether students 
had pa rents with low or high levels of political knowledge. 



Table 10- Redictors of Student Political Knowledge 
Post- Treatment (Survey 2) - Subsamples with Patent Data 


Model 1 - Students Wit 
With Low Levels of Politic a 


i Parents 
Knowledge 


Model 2 - Students with 
With High Levels of Politic a 


Parents 

Knowledge 




Coeffic ient 


S.E. 




Coeffic ient 


S.E. 


Intercept 


1.10+ 


0.57 


Intercept 


2.15* 


0.81 


Political 

knowledge 

pre-test 


0.86** 


0.08 


Po litic a 1 

knowledge 

pre-test 


0.96** 


0.10 


White 


-0.22 


0.42 


White 


-0.22 


0.60 


Female 


-0.41 


0.26 


Female 


0.17 


0.35 


Year in 
school 


0.02 


0.14 


Yearin 

school 


-0.32+ 


0.19 


Treatment 
group 1 


-0.18 


0.32 


Treatment 
group 1 


-0.98* 


0.46 


Treatment 
group 2 
in an AP or 
honors 
course 


0.09 


0.58 


Treatment 
group 2 
in an AP or 
honors 
course 


0.47 


0.64 


Treatment 
group 2 not 
in an AP or 
honors 
course 


2 27** 


0.41 


Treatment 
group 2 not 
in an AP or 
honors 
course 


-0.64 


0.44 


Adjusted R- 
squared 


0.72 


Adjusted R- 
squared 


0.65 


N 


86 


N 


66 



Notes: "Ihe dependent variable is the scale of political knowledge measured in survey 2 afterthe magazine 
intervention. Coefficients a re unstandardized Ordinary Least Squares regression estimates. 

+ P <0.10, *p <0.05, **p <0.01 (Two-tailed tests) 
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Among students with parents who had low levelsof political knowledge, students in 
treatment group 2 who were not in an AP orhonorscourse scored hig heron political 
knowledge in wave 2 while controlling fortheir levels of political knowledge in wave 1. 
The same was not true for advanced students in treatment group 2. This suggests that the 
intevrention had the greatest effect forstudents with the potentially greatest level of 
need - studentswho were not in an advanced course, and whose parents scored low 
on the scale of political knowledge. The intervention made no measurable difference for 
students in treatment group 2 whose parents scored high on the knowledge scale. 
Students in treatment group 1 whose parents scored high in political knowledge, 
however, actually had lowerlevelsof politial knowledge in wave 2. 

Analyzing student efficacy while taking into account parent efficacy also generated 
evidence that the intervention may have offered the greatest benefit to those students 
in greatest need. 



table 11- Predictors of Student Internal Political Efficacy 
Post- Treatment (Survey 2) - Subsamples with Parent Data 


Model 1 - Students With Parents 
With Low Levelsof Political Efficacy 


Model 2 - Studentswith Parents 
With High Levelsof Political Efficacy 




Coeffic ient 


S.E. 




Coeffic ient 


S.E. 


Intercept 


0.64 


1.37 


Intercept 


4.26** 


1.06 


Political 

efficacy 

pre-test 


0.76** 


0.09 


Political 

efficacy 

pre-test 


0.66** 


0.07 


White 


0.63 


0.72 


White 


-1.77** 


0.64 


Female 


0.22 


0.40 


Female 


0.02 


0.41 


Year in 
school 


0.14 


0.21 


Yearin 

school 


0.65** 


0.24 


Treatment 
group 1 


0.41 


0.53 


Treatment 
group 1 


0.34 


0.49 


Treatment 
group 2 
in an AP or 
honors 
course 


0.96 


0.73 


Treatment 
group 2 
in an AP or 
honors 
course 


-1.07 


0.90 


Treatment 
group 2 not 
in an AP or 
honors 
course 


1.19* 


0.56 


Treatment 
group 2 not 
in an AP or 
honors 
course 


-0.50 


0.57 


Adjusted R- 
squared 


0.53 


Adjusted R- 
squared 


0.60 


N 


84 


N 


68 



Notes: The dependent variable is the scale of internal political efficacy measured in survey 2 after the 
magazine intervention. Coefficientsare unstandardized Ordinary Least Squares regression estimates. 

+ p <0.10, *p <0.05, **p <0.01 (Two-tailed tests) 
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Among students whose parents scored low on the scale of internal political efficacy, 
students in treatment group 2 who were not in an advanced class scored hig heron the 
efficacy scale in wave 2 when controlling fortheirfeelings of efficacy in wave 1. This 
suggests that reading about politicsand discussing that information with parents may 
help strengthen students' sense of efficacy, even when their pa rentsdo not have high 
levels of efficacy themselves. The intervention had no measurable effect on students 
whose parents scored high in political efficacy. 

Taken together, the results indicate that exposing students to newscoverage about 
politics, and having those students discuss what they read with theirparents, may make 
students more knowledgeable and efficacious, but the effect is limited to students whose 
parents score low in measures of their own knowledge and efficacy. To the extent that 
these traits may be passed on from parent to child, an intervention like the one tested 
here could counteract those parental influences and lead to students who are more 
informed and engaged. 

These results, while promising, are still somewhat speculative given the small sample sizes. 
But, at a minimum,, the evidence begsforfurther research in thisarea to confirm thatthis 
type of intervention may succeed in reaching the very students who could benefit the 
most- students outside of advanced classeswhose parents score low on measuresof 
political knowledge and efficacy. 



Discussion and Conclusion 

We found support for many of our hypotheses in the multivariate analyses. We predicted 
that students who were in the habit of reading and discussing articlesabout politicseach 
weekwould be more likely to seekout additional information about politicsusing media 
and family members (hypothesis #1). This was true for students in treatment group 2, who 
discussed the articles in class and at home with theirparents. The effect was significant 
only for students in the treatment group who were not in AP or honors classes however. 

We expected that knowledge about politics would increase forstudents in both 
treatment groups as a result of the intervention (hypothesis #2) and that the greatest 
gains would occuramong students in treatment group 2 due to the reinforcing effectsof 
discussing the articlesat home and in school (hypothesis #3). We found that knowledge 
rose in both treatment groups, as well as in the control group, from survey 1 to survey 2, 
and remained atthe increased level in survey 3, six weeks after the experiment ended. 

It isworth pointing outthatthe experiment coincided with the 2008 presidential primary 
and caucus season. The across-the-board increases for a II three groups may have been 
due in part to the timing of the experiment, with students overall paying more attention 
to politic s d uring the period covered bythe three surveys. Repeating the knowledge 
measures a cross the three surveysalso may have contributed to a learning effect 
among all three groups. Even with those two caveats, however, there is still evidence of 
a greater benefit occurring among the students assigned to discuss the magazine 
articles with theirparents. When we broke down the treatment 2 group bywhetherthe 
studentswere in an AP orhonorsclass, the benefitsof the treatment fell exclusively to 
those studentswho were not in an AP or honors class, suggesting thatthe more 
advanced studentswere already relatively knowledgeable about politicsgoing into the 
experiment. 
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We also hypothesized that the intervention would make students more confident about 
their grasp of politics, and that internal political efficacy would increase a mong students 
in the two treatment groups (hypothesis #4). We predicted thatthe effectwould be 
strongest among those studentswho discussed the articlesat home with at least one 
parentand in school (hypothesis #5). We found evidence of an increase in internal 
political efficacy, but only fortreatment group 2. Also, the greatest gainsoccurred 
among studentswho were in AP and honors classes, suggesting thatthere was 
something about those students' aptitude orview of themselves as citizens that made 
them more receptive to the benefits of reading about and discussing politics at home 
and at school. 

Returning to the classroom six weeks afterthe intervention ended, we had expected to 
find thatthe treatment groups would have experienced a longer-term benefit from 
reading and discussing the articles (hypothesis #6). This was not the case when it came 
to information-seeking. Ihe scale of media use and interpersonal discussion dropped for 
all three groupsfrom survey 2 to survey 3, falling below the levels that had existed before 
the experiment forthe control group and the treatment 2 group. Political knowledge, on 
the otherhand, increased forall three groupsfrom survey 1 to survey 2 and remained 
higher in survey 3 compared to survey 1. That this occurred even forthe control group 
may have been due to the timing of the research, during the presidential primary and 
caucus season, a swell as the presence of honors and AP students in the control group. 
The greatest gains, however, occurred among treatment group 2, and those gains 
persisted in the third survey. In terms of internal political efficacy, only treatment group 2 
saw a gain from survey 1 to survey 2, and that gain persisted in survey 3. Although the 
control group did not see a gain in political efficacy from survey 1 to survey 2, there was 
a statistically significant gain forthe control group from surveys 1 and 2 to survey 3. We 
can only attribute that gain to factors outside the research design. 

Taking into account parental influence added nuance to the findings. We hypothesized 
that students whose parents score low on measuresof information-seeking, political 
knowledge, and political efficacy would be more likely to benefit from the experimental 
intervention than would students whose parents scored high on those dimensions 
(hypothesis #7). We found this to be the case for political knowledge and efficacy, but 
only forstudents who were not in an AP orhonorsclass. Thus the studentswho potentially 
could benefit the most from the intervention did so. The small samples in these analyses 
prompt us to temper our conclusions he re with some caution, but the evidence suggests 
that this is an area worthy of future research. 

A theme that recurs in these findings is that, even with random assignment in an 
experiment, all students are not created equal, and therefore the benefits of the 
intervention varied along an important dimension. Among the entire pool of 361 
students, those who were not in an AP or honors class we re most likely to increase their 
level of information-seeking and learn more about politicsasa result of reading the 
articlesand discussing them at home and in class than their more advanced 
counterparts. But the students in the AP and honors classes were more likely to grow in 
their fee lings of internal political efficacy as a result of reading and talking about the 
material at home and in school. 

These are valuable lessons, not only for scholars, butalso for practitioners. Ifourschools 
are to build a more informed and engaged citizenry, we need to be mindful thatthe 
effects of those effortswill not be uniform across students. This suggests the need formore 
careful designs of curricula involving newsmedia to increase the chancesthat more 
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students realize the maximum benefit of media use and discussion. Educators may want 
to raise the bar when it comes to the level of sophistication of the readings for advanced 
students to increase their politic a I knowledge. On the otherhand, educators might 
considerspending more time relating media content to students' viewsabout 
themselvesand their role in civic life to build efficacy among studentswho are not in 
advanced courses. It also seemsclearthat short-term interventions tend to yield short- 
term benefits.To increase the probability of altering levels of information-seeking, 
knowledge and efficacy overthe long term, educators should be mindful that media use 
needs to be habitual, extending beyond one unit of a social studies course or even one 
course in high school. 

We offerthese findings with the qualification that the results a re from one experiment 
involving foursuburban high schools in a Northeastern state. The studentswho 
participated in the experiment did not necessarily constitute a representative sample of 
high school students across the country, oreven in theirown schools. Also, the timing of 
the experiment coincided with a period in which the public in general, as well asthe 
students involved in this experiment, were paying close attention to the presidential 
nominating process. The effectsofthe intervention may have been different during 
anotherperiod in American politics. Forexample, the contrast between the treatment 
and control groupsmight actually be greaterduring a period in which people are not 
following presidential politics. 

These qualifications do not overshadow the differences that emerged among the 
students during the experiment. Assigning students to read and discussarticlesabout 
politicshad a beneficial effect, especially when parentswere involved. The more 
educatorscan do to build and maintain that connection between school and home, 
the greaterthe likelihood that educatorsand parentscan worktogetherto create a 
more knowledgeable and efficacious citizenry. 
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Appendix A - StuderrtQuestionnaire 

Rutgers 

Eagleton Institute of Politics 



Introduction 

Thanks for helping us with this survey. We are conducting a confidential survey of high 
school students, and would very much like to include youropinions. Please circle the 
response that best reflects your answer to each question. All answersare completely 
confidential, and yourpartic ipation is voluntary. As thanks for taking the time to 
complete the survey, we are offering studentsa $5 Amazon.com giftcard. The survey 
should take you 10 - 15 minutesto complete. 

1. Are you currently registered to vote atthe address where you now live or not? 
(Please circle a response) 

No Yes 

2. Out of the lastseven days, how many days have you read a local newspaperlbr 
information about government or politics? (Please circle a response) 

01234567 Don't know 

3. Out of the lastseven days, how many days have you read a national newspaper, 
such as USA Today or the Whll Street J ouma I, for information a bout government or 
politics? (Please circle a response) 

01234567 Don't know 

4. Out of the lastseven days, how many days have you listened to a radio newscast 
for information a bout government or politics? (Please circle a response) 

01234567 Don't know 

5. Out of the lastseven days, how many days have you watc hed a local television 
newscastfor information about govemmentor politics? (Please circle a response) 

01234567 Don't know 



6. Out of the lastseven days, how many days have you watched a national 

television newscastfor information a bout government or politics? (Please circle a 
response) 

01234567 Don't know 
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7. Out of the lastseven days, how many days have you lead a news site on the 
Intemetfor information about government or politics? (Please circle a response) 

01234567 Don't know 

8. Out of the lastseven days, how many days have you lead a blog on the Internet 
for information a bout government or politics? (Please circle a response) 

01234567 Don't know 

9. Out of the lastseven days, how many days have you listened to a podcast on the 
Intemetfor information a bout government or politics? (Please circle a response) 

01234567 Don't know 

10. Outof the lastseven days, how many days have you talked about govemmentor 
politics with someone in yourlamily? (Please circle a response) 

01234567 Don't know 

11. In the pastfour weeks, how many weeks have you lead a newsweekly magazine, 
such aslime or Newsweek, to get information about government or politics? 

0 1 2 3 4 Don't know 
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Do you agree ordisagree with the following statements? (Please circle a response) 


12. 1 consider myself 

well-qualified to participate 
in politics. 


Agree 

strongly 


Agree 

somewhat 


Neither 

agree 

nor 

disagree 


Disagree 

somewhat 


Disagree 

strongly 


Don’t 

know 


13. 1 feel that 1 have a 

pretty good understanding 
ofthe important political 
issues facing our country. 


Agree 

strongly 


Agree 

somewhat 


Neither 

agree 

nor 

disagree 


Disagree 

somewhat 


Disagree 

strongly 


Don’t 

know 


14. 1 think that 1 am as 

well-informed a bout politics 
and government as most 
people. 


Agree 

strongly 


Agree 

somewhat 


Neither 

agree 

nor 

disagree 


Disagree 

somewhat 


Disagree 

strongly 


Don’t 

know 


15. Rjblic officials don't 
care muc h what people 
like me think. 


Agree 

strongly 


Agree 

somewhat 


Neither 

agree 

nor 

disagree 


Disagree 

somewhat 


Disagree 

strongly 


Don’t 

know 



16. Overthe years, how muc h attention do you feel the government pays to what 
people think when it dec ides what to do — a good deal, some, or not much? 
(Please circle a response) 

A good deal Some Not much Don't know 

17. How much ofthe time do you think you can tmstthe government in Washington 
to do what is right- just a bout always, most of the time, only some ofthe time, or 
none ofthe time? (Please circle a response) 

J ust about always 

Most ofthe time 

Only some ofthe time 

None ofthe time 

Don't know 
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18. Do you think that people in the national government waste a lotof money we pay 
in taxes, waste some of it; ordon't waste very much of it? (Please circle a 
response) 

A lot Some Not very much Don’t know 



Now we have a set of questions concerning various public figures. We want to see how 
much information a bout them getsoutto the public Horn television, newspapers and the 
like. 



19. Nancy Relosi. What job or political office does she now hold? (Please write 

a response in the space below) 



20. Die k C heney. What job or political office does he now hold? (Please write 

a response in the space below) 



21. Vladimir Ritin. What job or political office does he now hold? (Please write 

a response in the space below) 



22. John Roberts. What job or political office does he now hold? (Please write 

a response in the space below) 



23. Now, thinking of the three btanc hes of government; whose responsibility is itto 
determine if a law is constitutional or not? Is itthe president; the Congress orthe 
Supreme Court? (Please circle a response) 

President Congress Supreme Court Don’t know 
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24. Which political party has the most 
members in the U.S House of Representatives? 
(Please circle a response) 


Republican 

Party 


Democratic 

Party 


Don't know 


25. Whic h political party has the most 
members in the U.S Senate? (Please circle a 
response) 


Republican 

Party 


Democratic 

Party 


Don't know 


26. Of the two political parties, which one is 
mote conservative than the other? (Please 
circle a response) 


Republican 

Party 


Democratic 

Party 


Don't know 



27. What is your age? 



28. What is your gendei? (Please circle a response) 

Female Male 



29. What is your year in sc hool? (Please c irc le a response) 

9 th 10 th 11 th 12 th 



30. Are you of Latino or Hispanic origin, such as Mexican, Rjerto Rican, Cuban orsome other 
Spanish background? (Please circle a response) 

Yes No 



31. Are you white, black orof Asian origin? (Please circle a response) 

White Black Asian Other (please specify) 



lhatconcludes our survey, lhankyou very much for your time. 



Vercellotti and Matto 



38 I P a g e 



CIRCLE Working Pa per 72 



www.civicyouth.org 



Appendix B- F& rent Questionnaire 

Rutgers 

Eagleton Institute of Politics 



CIRCLE Pa rent Telephone Survey 

Sample: Pa rents participating in Eagleton'sstudy of the effects of political discussion on 

youth knowledge and efficacy 



Consent 



Hello, my name is and I'm calling on behalf of the Eagleton Institute 

of Politics at Rutgers University. Rutgers is conducting a study of civic engagement 
among high school studentsand theirparents. Yourson ordaughter'sschool sent home 
information a bout the study recently. This survey should take no more than nine minutes 
to complete, and all answersare completely confidential. May I please speakto [INSERT 
NAME FROM SAMPLE]? 

[IF RESPONDENT HASTO COMETO THE PHONE, RE-READ THE CO NSENTSTATEM ENT IF 
RESPO NDENTIS NOT AVAILABLE, SCHEDULE A CALLBACK.] 

[WHEN RESPO NDENTIS ON THE PHONE] 

Your participation iscompletely voluntary, you mayend your participation atanytime, 
and you may skip questions you do not want to answer. May I ask the first question? 

A. Gender (BY OBSERVATION) 

1 Male 

2 Female 



Voter registration 



Registration 

RL1. Are you currently registered to vote at the address where you now live or not? 

1 Yes 

2 No 

9 Don't Know/Refused (DO NOTREAD) 



Media consumption 
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Ml. Out of the last seven days, how many days have you for 

information about government or politics? 

A Read a local newspaper 

B Read a national newspaper, such as USA Today orthe Wall StreetJ oumal 
C Listened to a radio newscast 
D Watched a local television newscast 
E Watched a national television newscast 

F Read a news site on the Internet 

G Read a blog on the Internet 

H Ustened to a podcast on the Internet 

0 Odays 

1 1 day 

2 2 days 

3 3 days 

4 4 days 

5 5 days 

6 6 days 

7 7 days 

9 Don't Know/Refused (DO NOTREAD) 

M1A1. Out of the last seven days, how many days have you talked about government 
or politics with someone in yourfamily? 

0 Odays 

1 1 day 

2 2 days 

3 3 days 

4 4 days 

5 5 days 

6 6 days 

7 7 days 

9 Don't Know/Refused (DO NOTREAD) 

M2. In the past four weeks, how many weeks have you read a newsweekly magazine, 
such asTime or Newsweek, to get information about government or politics? 

0 Haven't read a newsweekly magazine in the pastfourweeks 

1 One week 

2 Two weeks 

3 Three weeks 

4 Fourweeks 

9 Don't know/Refused (DO NOTREAD) 



Political efficacy 



EF1. Do you agree ordisagree with the following statements: 

A I consider myself well-qualified to participate in politics. 
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B I feel that I have a pretty good understanding of the important political 
issuesfacing ourcountry. 

C I thinkthat I am as well-informed about politicsand government asmost 
people. 

D Public officials do n't care much what people like me think. 

1 Agree strongly 

2. Agree somewhat 

3 Neitheragree nordisagree 

4 Disagree somewhat 

5 Disagree strongly 

9 Don’t know/Refused (DO NOTREAD) 

EF2. Overthe years, how much attention do you feel the government pays to what 
people thinkwhen it decides whatto do -- a good deal, some, ornot much? 

1 A good deal 

2 Some 

3 Not much 

9 Don’t know/Refused (DO NOTREAD) 



Trust in government 



1R1. How much of the time do you thinkyou can trust the government in Washington 

to do what is right - just about always, most of the time, only some of the time, or 

none of the time? 

1 J ust about always 

2 Most of the time 

3 Only some of the time 

4 None of the time 

9 Don’t know/Refused (DO NOTREAD) 

1R2. Do you thinkthat people in the national government waste a lot of money we 
pay in taxes, waste some of it, ordon't waste very much of it? 

1 A lot 

2 Some 

3 Not very much 

9 Don’t know/Refused (DO NOTREAD) 



Political knowledge 



Now we have a set of questions concerning variouspublic figures. We want to 
see how much information a bout them gets out to the public from television, 
newspapers and the like. 

KN1. Nancy Pelosi. What job orpolitical office doesshe NOW hold? (DO NOTREAD 
RESPO N SE C A1EG 0 Rl ES) 

1 Correctly identifiesasSpeakerof the House of Representatives 
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2 Correctly identifies as a memberof Congress 

3 Identification is incomplete orwrong 

9 Don't know/Refused to respond 

KN2. DickCheney. What job orpolitical office does he NOW hold? (DO NOTREAD 
RESPO N SE C A1EG 0 Rl ES) 

1 Correctly identifies as Vice President 

2 Identification is incomplete orwrong 

9 Don't know/Refused to respond 

KN3. VladimirPutin (Pronounced Poo-tin). What job orpolitical office does he NOW 
hold? (DO NOTREAD RESPONSE CATEGORIES) 

1 Correctly identifies as president of Russia 

2 Identification is incomplete orwrong 

9 Don't know/Refused to respond 

KN4. J ohn Roberts. What job orpolitical office does he NOW hold? (DO NOTREAD 
RESPO N SE C ATEG 0 Rl ES) 

1 Correctly identifies asChief J ustice of the U.S. Supreme Court 

2 Correctly identifies as a Supreme Court justice 

3 Identification is incomplete orwrong 

9 Don't know/Refused to respond 

KN5. Now, thinking of the three branches of government, whose responsibility is it to 
determine if a law is constitutional ornot? Is it the president, the Congressorthe 
Supreme Court? 

1 President 

2 Congress 

3 Supreme Court 

9 Don't know/Refused (DO NOTREAD) 

-KN6. Which political party has the most members in the U.S. House of 
Representatives? 

1 The Democratic Party 

2 The Republican Party 

9 Don't know/Refused (DO NOTREAD) 

KN7. Which political party hasthe most members in the U.S. Senate? 

1 The Democratic Party 

2 The Republican Party 

9 Don't know/Refused (DO NOTREAD) 

KN8 Of the two political parties, which one is more conservative than the other? 

1 The Democratic Party 

2 The Republican Party 
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9 Don't know/Refused (DO NOTREAD) 



Voter c ha rac teristic s 



PID1. We're almost finished. We have just a few more questions to help us understand 
oursurvey results. 

In politicstoday, do you consideryourself a Democrat, Republican, Independent, 
orsomething else? 

1 Democrat 

2 Republican 

3 Independent 

4 Something Else / Other 

9 Don't Know / Refused (DO NOTREAD) 

IDEOL Regard less of the political party you might favor, do you consideryourself to be 
liberal, conservative, orsomewhere in between? 

1 Liberal 

2 Conservative 

3 Somewhere in between 

4 Other (DO NOTREAD) 

9 Don’t know/Refused (DO NOTREAD) 



Demographics 



D2. What wasthe last grade in school you completed? 

1 8TH GRADE OR LESS 

2 HIGH SCHOOL INCOMPLETE (GRADES 9, 10 AND 11) 

3 HIGH SCHOOL COMPLETE (GRADE 12) 

4 VO C AT10 NAL/TECHN 1C AL SCHOOL 

5 SOMECOLLEGE 

6 J UNIOR COLLEGE GRADUATE (2 YEAR, ASSOC I ATES DEG REE) 

7 4 YEAR C 0 LLEG E G RADUATE (BAC HELO R'S DEG REE) 

8 GRADUATE WORK (MASTERS, LAW/ MEDICAL SCHOOL, ETC.) 

9 Don’t know/Refused (DO NOTREAD) 

D3. What wasyourage on yourlast birthday? 

/ / / (ENTER AGE: 98=98+, 99 =DK/REFUSED) 

D3a . [IF DK/ REFUSED IN D3, ASK:] Is it between...? 

1 18-20 

2 21-24 

3 25-29 

4 THIRTIES (30 - 39) 

5 FORTIES (40 -49) 
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6 FIFTIES (50 - 59) 

7 60-64 

8 65 OR OVER 

9 Don't know/Refused (DO NOTREAD) 

D4. Are you of Latino orHispanic origin, such as Mexican, Puerto Rican, Cuban or 
some otherSpanish background? 

1 Yes 

2 No 

9 Don't know/Refused (DO NOTREAD) 

D5. Are you white, black or of Asian origin? 

1 White 

2 Black 

3 Asia n 

4 (VOL) Hispanic / Latino 

5 (VO L) OTHER, SPEC IFY: 

9 Don't know/Refused (DO NOTREAD) 

D6. So thatwe can group all answers, isyourtotal annualfamily income before taxes: 
Linder $35,000; between $35,000 to just under $70,000; between $70,000 to just 
under $100,000; or $100,000 or more? 

1 Under $35,000 

2 $35,000 to $69,999 

3 $70,000 to $99,999 

4 $100,000 or more 

9 (VOL) Don't Know / Refused 

lhatconc ludes our survey, lhank you very muc h foryourtime. 
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Appendix C - Weekly Discussion Guides 9 

Eagleton Institute of Politics 
In-Class Discussion of lime Articles 



Week 1 Discussion Guide 
Jan. 21- 25,2008 



Dear : 

Your classes have been randomly selected to be in treatment group #1 for the study. That 
meansthatyourstudentswill receive Time magazine each weekforthe nexteight 
weeks. We ask that your students read the assigned articleseach week, considerthe 
"thought questions," and discuss the articles in class. 

In this first week of the study, we would like your students to read the following three 
articles from the enclosed issue of Time magazine: 

1. "How Hillary Learned to Trust Herself," byj oe Klein on p. 22. 

2. "Fight forthe Party Faithful," by Michael Sc hereron pp. 38-39. 

3. "McCain's Independent Streak," by Ramesh Ponnuru on p. 41. 

Ideally, the students would get this assignment along with the following thought questions 
and have a night or two to do the reading and think a bout the questions before the in- 
class discussion. The in-class discussion should take about 20 minutes, and should be 
completed byjan. 25. If you could write the questionson the board forthe students, that 
would be helpful as well. 

Thought questions: 

1. (Regarding the J oe Klein article) - Barac k Obama was expected to win New 
Hampshire, and Hillary Clinton wasexpected to lose. Given the actual results, what 
lessonscan we learn about the role of the news media in setting expectations in 
elections? 

2. (Regarding the Michael Scherer article) - Do you thinkcandidatescampaign 
differently in different states based on voters' concerns in those states? How might a 
candidate campaign differently in New J ersey than in South Carolina? 

3. (Regarding the Ramesh Ponnuru article) - Why do so many voters identify 
themselves as Independents? Thinking about Ramesh Ponnuru'scommentary, what 
mightthe Republican Party have to do to win over Independents? 



9 Note: Teachers of the Treatment 2 groups received discussion guides with the same 
reading assignments and questions. The only difference was that the Treatment 2 
discussion guides included the following instructions: We ask that your students read the 
assigned articles each week, consider the “thought questions,” and discuss the articles at 
home with one or both parents and then in class as well. 
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Eagleton Institute of Politics 
In-Class Discussion of lime Articles 

Week 2 Discussion Guide 
Jan. 28 -Feb. 1,2008 



Dear : 

Your classes have been randomly selected to be in treatment group #1 for the study. That 
mea ns that yourstudents will receive lime magazine each weekduring the eight-week 
period of the study. We ask that yourstudents read the assigned articleseach week, 
considerthe "thought questions," and discuss the articles in class. 

In this second weekofthe study, we would like your students to read the following two 
articles from the J an. 28, 2008 issue of lime magazine: 

1. "Getting Backto Business," by Michael Duffy and Karen Tumulty, p. 29. 

2. "Breaking Down the Black Vote," byj ohn Cloud, p. 34. 

Ideally, the students would get this assignment along with the following thought questions 
and have a night or two to do the reading and think a bout the questions before the in- 
class discussion. The in-class discussion should take about 20 minutes, and should be 
completed by Friday, Feb. 1. If you could write the questionson the board forthe 
students, that would be helpful as well. 

Thought questions: 

1. (Regarding the "Backto Business" article) - The economy isbecoming a top 
concern of voters as they look ahead to the 2008 presidential election. How are the 
variouscandidatesaddressing the issue of the economy? Isone political party doing a 
betterjob than the otherat addressing voters' concerns? 

2. (Regarding the "Breaking Down the Black Vote" article) - Ascandidateshave 
begun to campaign in states such as Nevada and South Carolina, race has become an 
important issue. Why hasrace become important? Disc us how candidates' messages 
change based on the state in which they are campaigning. 

3. (Regarding the "Breaking Down the Black Vote" article) - In 2008, the Democratic 
Party has the potential to nominate either the first African American presidential 
candidate orthe first female presidential candidate. Would race orgendermake voters 
more or less likely to support a candidate? Why? 
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Eagleton Institute of Politics 
In-Class Discussion of lime Articles 

Week 3 Discussion Guide 
Feb. 4-8, 2008 



Dear : 

Your classes have been randomly selected to be in treatment group #1 for the study. That 
mea ns that yourstudents will receive lime magazine each weekduring the eight-week 
period of the study. We ask that yourstudents read the assigned articleseach week, 
considerthe "thought questions," and discuss the articles in class. 

In this third week of the study, we would like your students to read the following three 
artic lesfrom the Feb. 4, 2008 issue of lime magazine: 

1. "The Phoenix," byj amesCamey, p. 32. 

2. "Will Rudy Shine?" by Michael Scherer, p. 38. 

3. "The Black/Brown Divide," by Gregory Rodriguez, p. 39. 

Ideally, the students would get this assignment along with the following thought questions 
and have a night or two to do the reading and think a bout the questions before the in- 
class discussion. The in-class discussion should take about 20 minutes, and should be 
completed by Friday, Feb. 8. If you could write the questionson the board forthe 
students, that would be helpful as well. 

Thought questions: 

1. (Regarding the "The Phoenix" article) - Despite concemsamong conservatives, 

J ohn McCain is seen asthe frontrunner for the Republican nomination. What doesthe 
successof the McCain campaign tell usaboutthe unity of the Republican Party? If 
McCain wins the Republican nomination, will conservative voters support him? 

2. (Regarding the "Will Rudy Shine?" article) - Although the primary season began in 
earlyj anuary in Iowa and New Hampshire, Rudy Giuliani spent most of this time 
campaigning in Florida. What were the reasonsbehind thiscampaign strategy? Should 
Giuliani have stayed in the race until SuperTuesday so that he could have run in the New 
J ersey and New York primaries? 

3. (Regarding the "The Black/Brown Divide" article) - Nomination contests in such 
states as Nevada and California point to the role of Latino voters in the nomination 
process. Why do Latino voters play such an important role in choosing the presidential 
nominee? Will Latino voters support a Blackcandidate? Why orwhy not? 
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Eagleton Institute of Politics 
In-Class Discussion of lime Articles 

Week 4 Discussion Guide 
Feb. 11 - 15, 2008 



Dear : 

Yourc lasses have been randomly selected to be in treatment group #lforthe study. That 
means that yourstudents will receive lime magazine each weekduring the eight-week 
period of the study. We ask that yourstudents read the assigned articleseach week, 
considerthe "thought questions," and discuss the articles in class. 

In this fourth week of the study, we would like yourstudents to read the following two 
articles from the Feb. 11, 2008 issue of lime magazine: 

1. "It'slheirTum Now," by David Von Drehle, p. 34. 

2. "Endorsement Politics," by Karen Tumulty, p. 50. 

Ideally, the students would get this assignment along with the following thought questions 
and have a nightortwo to do the reading and thinkaboutthe questions before the in- 
class discussion. The in-class discussion should take about 20 minutes, and should be 
completed by Friday, Feb. 15. If you could write the questionson the board forthe 
students, that would be helpful as well. 

Thought questions: 

1. (Regarding the "It'slheirTum" article) - In statessuch aslowa and New 
Hampshire, young people have supported BarackObama overthe other Democratic 
candidates. Why do you thinkyoung votersare attracted to Obama? What hasthe 
Obama campaign done to reach out to young people and why doesthe outreach 
make a difference? 

2. (Regarding the "It'slheirTum" article) - The presidential campaign hasfocused 
attention on the importance of the youth vote. With that in mind, what issuesare 
important to young voters? Why are those issues important? 

3. (Regarding the "Endorsement Politics" article) - SenatorEdward Kennedy recently 
announced that he endorsed BarackObama for President. Whydo candidatesseek 
endorsements and why do they matter? What doesthe Kennedy endorsement of 
Obama tell us about the unity of the Democratic Party? 
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Eagleton Institute of Politics 
In-Class Discussion of lime Articles 



Dear 



Week 5 Discussion Guide 
Feb. 18 - 22,2008 



Yourc lasses have been randomly selected to be in treatment group #lforthe study. That 
means that yourstudents will receive lime magazine each weekduring the eight-week 
period of the study. We ask that yourstudents read the assigned articleseach week, 
considerthe "thought questions," and discuss the articles in class. 

In this fifth week of the study, we would like yourstudents to read the following two 
articles from the Feb. 18, 2008 issue of lime magazine: 

1. "Why Not Both?" by Michael Duffy, p. 32. 

2. "A Right Fight," by Michael Grunwa Id, p. 37. 

Ideally, the students would get this assignment along with the following thought questions 
and have a night or two to do the reading and think a bout the questions before the in- 
class discussion. The in-class discussion should take about 20 minutes, and should be 
completed by Friday, Feb. 22. If you could write the questions on the board for the 
students, that would be helpful as well. 

Thought questions: 

1. (Regarding the "Why Not Both?" article) - How likely is it that Senators Hillary 
Clinton and Barack Obama would run on the same ticket in the fall? Would either 
candidate be willing to run forthe vice presidency afterlosing the nomination to the 
other? Why orwhy not? Would a Clinton-Obama orObama-Clinton ticket help orhurt 
the Democrats' chancesto win the White House in November? Why? 

2. (Regarding the "A Right Fight" article) - J ohn McCain still faces op position from 
conservatives in hisparty. Will conservatives, unhappy about McCain'snomination, 
simply not vote in November? Would it be easierforMcCain to unite the Republican 
Party if Hillary Clinton is his opponent, or if Ba rack Obama is his opponent? Why? 
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Eagleton Institute of Politics 
In-Class Discussion of lime Articles 



Dear 



Week 6 Discussion Guide 
Feb. 25 - 29,2008 



Yourc lasses have been randomly selected to be in treatment group #lforthe study. That 
means that yourstudents will receive lime magazine each weekduring the eight-week 
period of the study. We ask that yourstudents read the assigned articleseach week, 
considerthe "thought questions," and discuss the articles in class. 

In this sixth weekofthe study, we would like your students to read the following two 
articles from the Feb. 25, 2008 issue of lime magazine: 

1. "Finding Their Faith," by Amy Sullivan, p. 38. 

2. "The Barack Blowout," byj oe Klein, p. 23. 

Ideally, the students would get this assignment along with the following thought questions 
and have a night or two to do the reading and think a bout the questions before the in- 
class discussion. The in-class discussion should take about 20 minutes, and should be 
completed by Friday, Feb. 29. If you could write the questionson the board forthe 
students, that would be helpful as well. 

Thought questions: 

1. (Regarding the "Finding TheirFaith" article) - This a rtic le isan excerptfrom a book 
by Amy Sullivan called The Party Faithful. Sullivan a rguesthat current Democratic 
presidential candidatesare addressing issuesof religion very differently than past 
Democratic candidates. What hasbeen the conventional wisdom among the 
Democratic Party regarding the use of religion and faith in presidential campaigns? 

What lessons did the party learn in 2004? 

2. (Regarding the "Finding TheirFaith" article) - AsauthorAmy Sullivan pointsout, 
Barack Obama and Hillary Clinton both seem to embrace religion on the campaign trail. 
Should votersfoc us on candidates' religious beliefs in choosing a president? Whyorwhy 
not? 



3. (Regarding the "Barack Blowout" article) - In his column, J oe Klein a rguesthat 
the Obama campaign hasbeen bettermanaged than the Clinton campaign. What 
are some qualitiesof a well-organized presidential campaign? Is it still possible forSen. 
Clinton to win the Democ ratic nomination? Why orwhy not? 
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Week 7 Discussion Guide 
March 3- 7, 2008 



Yourc lasses have been randomly selected to be in treatment group #lforthe study. That 
means that yourstudents will receive lime magazine each weekduring the eight-week 
period of the study. We ask that yourstudents read the assigned articleseach week, 
considerthe "thought questions," and discuss the articles in class. 

In this seventh week of the study, we would like your students to read the following two 
articles from the March 3, 2008 issue of lime magazine: 

1. "Changing the Script," by Michael Scherer, p. 32. 

2. "Courting J oe Six-Pack," by PeterBeinart, p. 31. 

Ideally, the students would get this assignment along with the following thought questions 
and have a night or two to do the reading and think a bout the questions before the in- 
class discussion. The in-class discussion should take about 20 minutes, and should be 
completed by Friday, March 7. If you could write the questionson the board forthe 
students, that would be helpful as well. 

Thought questions: 

1. (Regarding the "Changing the Script" article) - Michael Scherer points out that 

J ohn McCain will provide strong competition forthe Democrats in the fall because of his 
appealto independent voters. Why do you think independents find McCain to be such 
an attractive candidate? Among the two Democrats- Hillary Clinton and Barack 
Obama - who would have the best chance against McCain? Why? 

2. (Regarding the "Courting J oe Six-Pack" article) - Are there really such groupsas 
"Beer Democrats" and "Wine Democrats"? What are the key differences between the 
two groups? Of the two leading Democrats- Clinton and Obama - who would do a 
better job of uniting Democrats? Why? 

3. (Regarding the "Courting J oe Six-Pack" article) - The article arguesthatj ohn 
McCain may have trouble uniting Republic a ns bee a use of his sup port fora path to 
citizenship for illega I immigrants. How important will the issue of illegal immigration be in 
the presidential election? Do you thinkthe issue is more, orless, important in New J ersey 
than in borderstates like Arizona? Why? 
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Week 8 Discussion Guide 
March 10- 14, 2008 



Yourc lasses have been randomly selected to be in treatment group #lforthe study. That 
means thatyourstudentsare receiving lime magazine each weekduring the eight-week 
period of the study. We ask that yourstudents read the assigned articleseach week, 
considerthe "thought questions," and discuss the articles in class. 

Inthiseighth week of the study, we would like your students to read the following two 
articles from the March 10, 2008 issue of lime magazine: 

1. "Does Experience Matterln A President?" by David Von Drehle, p. 26. 

2. "The Bitter Ha If," by Karen Tumulty, p. 34. 

Ideally, the students would get this assignment along with the following thought questions 
and have a nightortwo to do the reading and thinkaboutthe questions before the in- 
class discussion. The in-class discussion should take about 20 minutes, and should be 
completed by Friday, March 14. If you could write the questionson the board forthe 
students, that would be helpful as well. 

Thought questions: 

1. (Regarding the "Does Experience Matter" article) - How much weight should 
votensgive to experience when choosing a presidential candidate? What specific types 
of experiences might be most helpful? A background in business? Serving as a governor? 
Serving asa memberof Congress? Why? 

2. (Regarding the "Does Experience Matter" article) - Presidential historian Richard 
Norton Smith isquoted assaying that character- "not just what they've done, but how 
they’ve done it, and what they learned from doing it" - is just as important as experience 
fora president. What c ha rac ter traits do you think are most important fora president? 
Why? 

3. (Regarding "The BitterHalf" article) - Has former President Bill Clinton helped or 
hurt his wife'scandidacy? How hashe helped hercandidacy? How hashe hurt her 
candidacy? Have the other candidates' spouses had similar effects, or is this unique to 
the Clintons? Why? 
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